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(54) Device and method for determining movement 



(57) A high resolution device for determing movement of a surface relative to a detector, the detector 
comprises a coherent source of radiation 2 eg. a laser directed at the surface 8 or a ball in contact therewith, 
and a plurality of radiation sensors 3 arranged to detect an intensity pattern eg. laser speckle pattern due to 
interference in the radiation reflected back from the surface. Outputs from the sensors are repeatedly sampled 
or continuously monitored and comparison means is used to calculate spatial and temporal intensity gradients 
between adjacent sensors to determine the successive displacement of the pattern. The device has particular 
use in a mouse or tracker ball for computer input, or in a digital microphone. 
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nwrrr. and method for determ ining movement 

Field of the Invention 

This invention relates to a device for and method of determining movement 
of a surface. The device and method can he applied to a wide range of 
practical devices such as high resolution pointing devices for computers 
("pens", and mouse or tracker ball input devices), seismic detectors, digital 
microphones, precision instruments or machine tools, and computer output 
devices such as electrostatic plotters. 

Background to the Invention 

There is a need for an accurate pointing device for use with smaller personal 
computers, especially the notebook sized computers which are now becoming 
increasingly popular, and even smaller "tablet" computers, for which 
conventional keyboards cannot readily be used. Conventional pointing 
devices are not readily usable with such computers, because of their size, and 
"pen" pointing devices have been developed to meet this need. However, 
these typically have resolutions of the order of 100 dpi (dots per inch) 
equivalent to 250 fim, which is far too low for precise applications such as on- 
line, hand-written character recognition. Such applications become ever 
more desirable as size and other considerations lead away from the use of 
conventional keyboards as the means of inputting data. 

The conventional pointing devices used with desk-top computers, for 
example the mouse and the tracker ball, typically rely on sensing 
mechanically the movement of the balL Resolutions are still relatively low, 
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being of the order of 400 dpi, and the devices are subject to problems of 
reliability. 

When light impinges on a rough surface (in this context almost all surfaces 
are "rough"), for example paper, local interference of the reflected light via 
5 multiple path lengths gives rise to a pattern. This pattern depends upon the 
relative positions of the light source, the detector and the surface. The effect 
can be greatly enhanced by the use of an intense beam such as is available 
from a laser and is commonly known as laser speckle. As the surface moves 
with respect to the source, the speckle pattern moves in a way that is directly 
10 related to the relative motion. It has been found that by detecting the 
movement of this pattern, the movement relative to the surface can be 
detected with greatly enhanced resolution. 

It has previously been proposed to use laser speckle in velocity measurement. 

For example, EP-A-0 295 720 discloses a device for measuring the speed of a 
15 manufacturing line which has a spaced pair of detectors detecting the passage 

of intensity peaks in laser light scattered back from the moving surface of the 

line. Length of an object on the line can also be measured by the device. 

Dobrido et al (Opt Spectrosc. (USSR) 65(1), July 1988, 125-6) disclose a 

speckle correlator for studying rough surface displacements using 
20 photographically recorded speckle images. Neither of these proposals 

permits real-time movement detection in two dimensions. 

Attempts have been made to use speckle patterns in the construction of a 
pad-less optical mouse, for example in US 4,794,384 (Xerox Corporation). 

This technology uses ,f bit wise auto correlation" to compare a given bit value 
25 for each of the 256 cells in a 16 x 16 sensor array with the bit value of 
neighbouring cells surrounding the given cell to determine how many such 
comparisons are the same and then a count is made of the number of such 
comparisons for different groups of identical cell pair comparisons. 

The Xerox system is, therefore, based upon a preponderance of "Votes" 
30 determining a direction of movement. The system utilizes the concept of 
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comparing values of samples neighbouring a previous sample with each array 
cell value in a new sample to determine if they are the same. If any of the 8 
comparisons provide an indication of being the same, whether a dark feature 
or a light feature, then there is a possibility that the pattern feature being 
5 detected has "moved" to a new cell position. An identical cell pair value 
counts as one point and the appropriate counter representing that pair 
comparison is incremented. It can be seen then that if a certain majority of 
light features detected in the speckle pattern presented to the ray have 
moved in a given direction and also a given majority of dark features have 
10 moved in the same direction, a reliable indication has been derived that the 
relative motion between the array and the reflecting surface is in the given 
direction. 

This method of comparison incurs a substantial processing cost and typically 
high level resolution cannot affordably be achieved at the processing speeds 
15 necessary to give real-time movement detection in two dimensions. 

What would be simpler and more affordable would be to have a device for 
determining the extent and direction of movement, to a high degree of 
accuracy, but which did not rely upon the capture, storage and comparative 
analysis of successive images. 

20 Summary of the Invention 

According to the invention, there is provided a device for determining 
movement of a surface relative to a detector, the detector comprising a 
source of radiation directed at the surface and a plurality of radiation sensors 
arranged to detect an intensity pattern due to interference in the radiation 
25 reflected back from the surface, the device also comprising means for 
repeatedly or continuously monitoring the outputs from the sensors, and 
comparison means for calculating the interstitial spatial and temporal 
intensity gradients between adjacent sensors and using said gradients to yield 
a result indicative of the movement of the surface relative to the detector. 

30 Preferably, the radiation is from a coherent source, for example a laser. The 
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detectors are preferably arranged in a two-dimensional array, with the 
displacement being calculated for each orthogonal direction. It has been 
found that, while a large array of sensors will give high precision, satisfactory 
performance, in terms of resolution and speed, can be obtained using a 
5 relatively small number of sensors, for example a pair of intersecting linear 
arrays each having only eight sensors or pixels. As few as two sensors in each 
direction can be used with acceptable results still obtainable. 

Preferably the device has more than two sensors and/or monitors the outputs 
from the sensors continuously or for many repeats thereby enabling spatial 
10 and/or temporal over-sampling, respectively. 

The invention also provides a method or determining movement of a surface, 
comprising directing radiation at the surface and detecting an intensity patter 
due to interference in the radiation from the surface, repeatedly or 
continuously monitoring the outputs from the sensors, and comparison means 
IS for calculating the interstitial spatial and temporal intensity gradients 
between adjacent sensors and using said gradients to yield a result indicative 
of the movement of the surface relative to the detector. 

The device is suitably a pointing device for a computer and comprises a body 
having an aperture therein movable across a surface and means for mounting 

20 within the body in fixed relation to the aperture the radiation source and 
detector of said device, and interface means for transmitting to a computer 
signals representing the movements determined thereby. Alternatively, the 
body has a ball rollably mounted therein and means for mounting within the 
body in fixed relation to the surface of the ball the radiation source and 

25 detector of said device. Thus, the device may take the form of a mouse or a 
tracker ball 

The ultra-high resolution obtainable by devices in accordance with the 
invention permits their use in applications where only small movements are 
available. Conventional tracker balls typically require movements of many 
30 rotations in order to cover significant distances on the display of the 
associated computer. Their low resolution means that direction of small 
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movements, such as would be required in handwriting recognition, would not 
be possible. Another embodiment of the invention provides a tracker ball 
engageable by a pen to register small movements and by the hand to make 
large movements across the display. The high resolution of the tracker ball of 

5 the invention gives the gain necessary to travel large distances across the 
display, while retaining the "pen-point" precision necessary in drafting, 
writing or other pen applications. The ball is suitably made larger than in a 
conventional tracker ball device, and the surface is suitably dimpled to assist 
engagement of the pen point A very light suspension for the ball will 

10 facilitate its use in this way. A significant advantage of this arrangement is 
that absolute positioning is not lost if the pen leaves the writing surface. 

It has been found that the focus of the detector is not critical; it is not 
necessary for the detector to be focused on the surface, and in some 
circumstances better results may be obtainable when the surface is not in 
15 focus. 

The radiation, which is preferably coherent radiation, will conveniently be 
infra-red radiation for pointing electromagnetic device applications; suitable 
optical filters can then ensure that the effects of ambient radiation are 
ininimised. However for certain applications, radiation of other wavelengths 

20 may be preferred and conceivably alternative non-electromagnetic, eg. 
particulate or audio, forms of radiation which also generate interference 
patterns may be used. For example, the method may be applicable to X-ray 
lithographic manufacturing techniques to ensure accurate positioning. The 
method is thought to be capable of positioning to tens of nanometres or 

25 better. 

In an alternative application of the invention to that described immediately 
above, the device for determining movement of a surface relative to a 
detector serves as a digital microphone and has a diaphragm responsive to 
sound waves wherein the radiation impinges on the surface of the diaphragm 
30 in order that motion normal to the diaphragm can be detected by measuring 
the displacement of the speckle pattern. 



Brief Descript ion of the Drawings 



Figure 1 is a diagrammatic sectional elevation of a "pen" pointing device in 
accordance with the invention; 

Figure 2 is a corresponding view of an alternative arrangement using a ball as 
the surface whose movement is directly detected to give a measure of 
movement of the ball over a working surface; 

Figures 3 and 4 are views illustrating slightly modified versions of the device 
shown in Figure 1; 

Figure 5 is a diagrammatic sectional elevation of a "mouse" pointing device in 
accordance with the invention; 

Figure 6 is a partial sectional elevation of a tracker ball pointing device in 
accordance with another embodiment of the invention; 

Figure 7 illustrates a modified form of the device shown in Figure 6; 

Figure 8 is a diagram showing an alternative arrangement for the optical 
components in any of the preceding embodiments; 

Figure 9 is a diagram illustrating one stage in one algorithm for determining 
movement; 

Figure 10 is a block circuit diagram of a sampling and calculating means for a 
device in accordance with the invention; 

Figure 11 illustrates one implementation of a component of Figure 10; 

Figures 12 and 13 illustrate alternative implementations of another of the 
components of Figure 10; 

Figure 14 illustrates the basis for an alternative algorithm for determining 
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movement; 

Figure 15 is a block circuit diagram of an alternative calculating means to 
that illustrated in Figure 10. 

Figure 16 is a circuit diagram of one block of a sampling stage for the circuit 
5 shown in Figure 15. 

Figure 17 is a graphical representation of a typical intensity profile through 
laser speckle; 

Figure 18 shows diagrammatically, without showing its random nature, a 
speckle pattern of a laser spot; 

10 Figure 19 is a diagrammatic representation of a one dimensional array of 
pixels in time; and 

Figure 20 is one possible arrangement of the laser source and the detector 
array in a digital microphone. 



15 Description of the Illustrated Embodiments 

Referring first to Figure 1, the "pen" pointing device comprises a body 1 
containing a laser diode 2 and a photodiode detector array 3, each with a 
respective focusing optical system 4 and 5 respectively. The laser diode 2 and 
the array 3 are separated from each other by a light shield 6. The optical 

20 systems 4 and 5 are illustrated as being focused on a point corresponding to 
the plane of an opening 7 in the end of the body 1, the opening, in use, being 
brought into contact with the working surface 8, for example the display 
screen of a tablet computer. However, in practice, it is not essential for the 
optical systems to focus on the surface, and in some circumstances better 

25 results may be obtainable by focusing at a notional point above or below the 
surface. 
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In the alternative construction shown in Figure 2, the opening in the end of 
the pen body is replaced by a housing for a captive ball 20, and the optical 
systems 4 and 5 are then directed generally toward the surface of the ball 20 
within the body 1. 

5 In Figures 3 and 4 the ''pen" pointing device has the opening 7 in the end of 
the body 1 closed by a transparent cover 30 to prevent clogging with dust, 
paper fragments, or dirt, and to provide a smoother feel to the device as it is 
moved over a surface, for example of paper. In the embodiment of Figure 3, 
the optical systems 4 and 5 are arranged to converge approximately at the 

10 surface 8 with which the cover 30 is brought into contact, while in the 
embodiment of Figure 4, the point of convergence is beyond the cover 30, a 
protective glass layer 40 being placed over the surface 8 to prevent wear to 
the surface. The cover 30 is preferably in the form of a micro-lens. 

The mouse illustrated in Figure 5 comprises a conventional mouse body 50, 
15 having control buttons 51, and mounting in suitable suspension means (not 
shown) a ball 52. A laser diode 53 and associated optical system 54 directs 
light on to the surface of the ball within the body, in the same manner as in 
the embodiment illustrated in Figure 2. A detector array 55 is mounted 
adjacent to the laser diode 53, with its own optical system 56 directed towards 
20 the ball. A shield 57 separates the laser from the detector array. 

The arrangement shown in Figure 6, for a tracker ball device, is essentially 
the same as in the mouse shown in Figure 5, but inverted, the ball 52 suitably 
being larger. Figure 7 illustrates a modified form of the tracker ball shown in 
Figure 6, employing the high resolution available to enable its use in such 

25 applications as handwriting recognition. The surface of the ball 60 is 
provided with a plurality of uniformly-spaced dimples 61 engageable by the 
point of a pencil 62 or stylus or the like. The dimples are shown in the 
drawing on an exaggerated scale for clarity; in practice they would not need 
to be deep, and for precision there might need to be only a small distance 

30 between adjacent dimples. The ball could conveniently be made of a larger 
diameter than with conventional tracker balls to provide a flatter surface for 
writing, and to permit an acceptable range of movement in writing before the 
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pencil need be lifted from the ball. 

Figure 17 shows a typical intensity profile through a laser spot, reflecting off 
a 'rough* surface. Here, rough means not optically flat Constructive and 
destructive interference causes the intensity profile to vary, giving rise to the 

5 well known laser speckle effect Because laser speckle is generated by 
random undulations in the ffluminated surface, the speckle itself is random in 
nature. It should be noted that the relationship between speckle and surface 
features is not a simple one to one contour map, but every part of the 
resulting speckle image depends on every part of the ffluminated surface. A 

10 change in part of the surface under the spot could therefore cause the entire 
speckle pattern to change. 

Speckle is visible on a rough surface regardless of the angle of incidence of 
the light The angle of incidence does, however, appear to be an important 
factor in producing a usable pattern. Where the angle of incidence of the 
15 light source is near to the surface normal, the speckle pattern clearly follows 
the underlying motion of the surface relative to the detector. K the angle of 
incidence is shallow, however, while pattern motion is visible, it is somewhat 
obscured by a noise component in the image. 

While the angle at which the ffluminated surface is viewed by the detector 
20 does not appear to be critical, it has been found that many advantages can be 
gained by viewing in the same plane as the source. Figure 8 shows one 
arrangement of the fflumination/detection components by which this can be 
realised, with the light source 80 directed through a semi-reflective mirror 81 
on to the surface 82, the light scattered back from the surface being reflected 
25 by the semi-reflective mirror 81 on to the detector 83. 

As the ffluminated surface moves relative to the laser source and detector, 
the speckle pattern also moves. Part of the moving speckle pattern results 
from reflections off the surface in areas continuously under the laser spot 
during movement (towards the middle of the spot), while a second 
30 component arises from reflections off areas of the surface that either move 
under the spot or move out from under the spot during movement (at the 



• * • • • • • 



-10- 

periphery of the spot). Figure 18 illustrates this. 

Speckle from the centre of the spot 167 appears to move coherently with 
respect to surface movement, providing a means of tracking the surface, 
while speckle created by the periphery of the spot 168, appears more random 

5 in nature, adding 'dither 1 to the overall speckle image. If a large spot is used, 
the central area contributes a much larger amount to the speckle image than 
does the peripheral spot region (the ratio increasing with radius) resulting in 
mostly coherently moving speckle. Where a very small spot is used, the 
speckle appears to change mostly randomly with movement, and it is difficult 

10 to extract movement in this case. 

To measure movement of the surface in one dimension (in the plane of the 
surface), one could use two light sensors and track the intensity changes at 
the two points. However, the random nature of the speckle, and added dither 
means that by using more sensors, and averaging the results, we can improve 

15 the spatial resolution to which we can discriminate movement. This implies 
that resolution is not fundamentally limited to the wavelength (or some 
faction of) the light source used. This is effectively spatial oversampling. If 
more results per second are produced than are usually required, then these 
can also be averaged in time to improve resolution, this being temporal 

20 oversampling. 

A simple approach to determining movement from the speckle would be to 
sample an image of the speckle, and correlate this with subsequent images, in 
order to determine to where the speckle has moved. While undoubtedly this 
works, and is the basis of the method used in US 4,794384, it incurs a 
25 substantial processing cost. A more attractive high resolution and 
computationally low cost solution works as follows:- 

With reference to Figure 19, consider a one dimensional imaging array where 
we acquire a one dimensional image of a line through the speckle, at regular 
intervals in time. 

30 Consider the four pixels a Q , b 0 and a lf b x (their values represent intensity). 
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We can calculate the interstitial spatial and temporal intensity gradient 
between the four pixels as follows:- 

SpatialGradient = V^oq - b Q ) + (a^ - b{)) 

TemporcdGradient^WLiaQ - a{)+(bQ - brf] 

The units of spatial gradient are intensity level per pixel, and the units of 
temporal gradient are intensity level per sample time. If we multiply the 
spatial and temporal gradients together, we have a value whose units are 
intensity level squared per pixel sample time. We can then divide this by the 
square of the spatial gradient to yield a result with unit pixels per sample 
time, in other words, how many pixels the speckle has moved along the 
sensor within one sample time. 

Where only one calculation is made, this is simply the same as dividing the 
temporal gradient by the spatial gradient. Over the entire array however, we 
can form the sum:- 

n-1 n-1 

2(SGfcTGi)/X(SGf) .....Equation A 
i=l /=1 

over n pixels (where SG and TG are respectively the spatial and temporal 
gradients for each point in the array). This produces our oversampled 
displacement in terms of the number of pixels over which the speckle has 
moved during a sample time (the time to acquire the data). 

Unlike correlation, this algorithm produces a result directly, with no 
expensive search. Also unlike correlation however, limitations of the 
algorithm are that the speckle must move somewhat less than the size of the 
speckle features between each sample, otherwise tracking cannot be 
maintained Complexity of the above implementation can be traded for 
resolution if further simplification is required. 

Simplification 1. 



To render the multiplications from the calculation even less costly, the spatial 
gradient on the left of the equation A can be replaced by + or - 1, reflecting 
the direction of the spatial gradient (positive or negative). The scaling factor 
on the right becomes the sum of the absolution values of the spatial 
5 gradients. This yields equation B. 

n-1 n-1 

ZlSIGNfSGifrTGiyiABSfiGi) .....Equation B 



Simplification 2 



10 At a further cost of resolution, the temporal gradient can be replaced by + or 
- 1 reflecting the direction of the temporal gradient In this case, the scaling 
factor on the right becomes simply n-1, giving equation C. 

n-1 

^SIGNiSG^xSIGNCrGfi/in-l) .....Equation C 
15 i=l 



The following sets out another approach to obtaining a simple algorithm for 
extracting relative movement of the surface, usable in the embodiments 
described with reference to the drawings. The imaging array consists of a 
cross hair with 11 pixels in the X direction and 11 pixels in the Y direction 

20 (orthogonal to X). This can be realised as a small staring array of p-i-n 
photodiodes. The use of a staring array means that a continuous, rather than 
a sampled, image is available, and capture rate is purely a function of 
algorithm execution time. For general purposes, a capture rate of about 1 
MHz is likely to be suitable, but higher or lower rates may be selected 

25 according to the requirements of the particular application and the hardware 
implementing it 



The simple nature of the algorithm means that it is possible that it could be 
fabricated on a VLSI chip as an analogue process. To explain the algorithm, 
consider four grey values P, Q, R and S. P and Q represent the speckle values 
30 seen by two adjacent sensors, while S and R are the values from the same 
sensors a short time later. Figure 9 illustrates the relationship between the 



(12) 



UK Patent Application ,».GB ,,,,2 272 763 m,A 



(43) Date of A Publication 25.05.1994 



(21) 


Application No 9323537.2 


(51) 


INTCL 6 






G06K 11/08 11/18 


(22) 


Uate Ot riling lD.i1.139a 








(52) 


UK CL (Edition M ) 


(30) 


Priority Data 




G1AAA3 ACA AG17 AG18 AR2 AR6 AR7 AT21 AT3 




(31) 9223915 (32) 14.11.1992 (33) GB 




H4JJCXJ30H 




A444 4AB in 4A 1QQO 

9321 485 18.10.1993 




U Id Oa l»* 1 9m<H 






(56) 


Documents Cited 


(71) 


Appllcant(s) 




None 




The University of Sheffield 










(58) 


Field of Search 




Nncnmnratad in the United Kin ado ml 


UK LL (edition m J ulA AuA ALfcW AULA , rWU 








DLVX,H4JJCX 




Western Bank, Sheffield, S10 2TN, United Kingdom 




INTCL 5 G01P,G06K,H04R 


(72) 


Inventor(s) 








Peter Anthony Ivey 








Andrew David Houghton 






(74) 


Agent and/or Address for Service 








William Jones 








Willow Lane House, WiDow Lane, NORWICH, Norfolk, 








NR2 1EU, United Kingdom 







(54) Device and method for determining movement 

(57) A high resolution device for determfng movement of a surface relative to a detector, the detector 
comprises a coherent source of radiation 2 eg. a laser directed at the surface 8 or a bail in contact therewith, 
and a plurality of radiation sensors 3 arranged to detect an intensity pattern eg. laser speckle pattern due to 
interference in the radiation reflected back from the surface. Outputs from the sensors are repeatedly sampled 
or continuously monitored and comparison means is used to calculate spatial and temporal intensity gradients 
between adjacent sensors to determine the successive displacement of the pattern. The device has particular 
use in a mouse or tracker ball for computer input or in a digital microphone. 




Figl 



At least one drawing originally filed was informal and the print reproduced here Is taken from a later filed formal copy. 

This print takes account of replacement documents submitted after the date of filing to enable the application to comply 
with the formal requirements of the Patents Rules 1990. 
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represented in Figure 9, the next stage down on the Figure handles the P and 
S samples. Thus, the sample from the second buffer 103 is the R (or more 
recent) sample, and this passes direct to a first subtracter 104, whose other 
input is the S sample from the next stage, giving an output from the 
subtracter of (S-R). The sample R also passes to a second subtracter 105 
whose other input is the preceding sample Q, which has been passed on via 
an electronic transfer switch 106 and a third buffer 107 to provide the 
necessary delay. The output of the second subtracter is thus (Q-R), and this 
passes to a third subtracter 108 whose other input is the corresponding result 
from the next stage down, i.e (S-P). The result is thus ((Q-R)-(S-P)), which is 
equivalent to ((P-S)+(Q-R)). 

The sample Q also passes to a fourth subtracter 109 whose other input is the 
sample P from the next stage, the output from the subtracter 109 being (Q- 
P). This then passes to a fifth subtracter 110 whose other input is the output 
from the first subtracter 104. The result is ((S-R)-(Q-P)), which is equivalent 
to ((P-Q)+(S-R)), and this is passed to an ABS stage 111 which outputs the 
absolute (positive) value of the spatial gradient L This stage is described in 
more detail hereinafter with reference to Figure 11. 

The output from the fifth subtracter also passes to a multiplier 112, described 
hereinafter in more detail with reference to Figure 12 or Figure 13. The 
other input to the multiplier 112 is the output from the third subtracter 108, 

Le ((P-S) + (Q-R)), and its output is equivalent to equation n. 

Referring to Figure 11, the ABS stage 111 comprises a comparator 113 which 
tests the sign of the input and switches the output through a sign-reversing 
stage if the input is negative or allows it through direct if the input is positive 
in sign. 

Figures 12 and 13 show alternative multipliers 112. Ideally, a four quadrant 
analogue multiplier would be used, but the illustrated embodiments are 
easier to implement. In the version shown in Figure 12, comparators 120 and 
121 test the sign of I and n, and an exclusive OR-gate 122 giving effectively 



+ 1 or -1 output This simplifies processing, but with a loss of possible 
resolution. Figure 13 illustrates a mixed analogue and digital version, in 
which the temporal gradient is multiplied by the sign of the spatial gradient 
This is achieved by a circuit which is essentially the same as that shown in 
5 Figure 11, except that the switching of the direct or sign-reversing paths is 
made according to the sign of the spatial gradient applied to the comparator 
130. The resolution achieved is intermediate to that achieved by a fully 
analogue approach and the fully digital approach of Figure 12. 

Returning to Figure 10, the outputs from the ABS stages 111 and the 
10 multipliers 112 are accumulated at 114 and 115 respectively to give the scale 
and displacement outputs. 

Figure 14 illustrates the basis for a simpler approach to the calculation, in 
which the samples P, Q, R and S are separated spatially and temporarily as 
shown. This simplifies the necessary calculation to (S-R)x(P-Q). Circuits for 

15 carrying out this approach are illustrated in Figures 15 and 16. The sample 
stages may be as illustrated in Figure 16 and as described hereinafter. For 
each subtraction, a pair of transistors is used. The transistors 150 and 151 in 
the first pair are set with their gain high such that there is effectively a digital 
output depending on the sign of (S-R). The second pair of transistors 152 and 

20 153 output values corresponding to P and Q, and the digital outputs from the 
first pair of transistors effectively switch, via devices 154 and 155, which of 
the P and Q values passes to the output, all the outputs being accumulated at 
156 to provide a displacement value. 

In the sampling circuit illustrated in Figure 16, the output of the p-i-n 
25 photodiode 160 passes via a buffer 161 and a sampling switch controlled by 
the basic clocking rate of the device to a first transistor 162 whose output 
provides the P sample. A first shift switch 163 passes this to a second 
transistor 164 whose output provides the R and S samples for the two 
adjacent calculating sections as illustrated in Figure 15. A second sampling 
30 switch 165 passes the signal to a third transistor 166 whose output provides 
the Q sample at the appropriate time. 
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It will be appreciated that, while bipolar transistors are shown in Figure 15 
and 16, the use of MOS devices would be preferable for most applications. 

The algorithms as described herein do not detect rotation of the surface 
relative to the detector, which could be important for a pen type application, 
5 especially in the recognition of handwriting. However, by employing a full 2D 

array of sensors, or a rosette of linear arrays, the rotation component may be 
calculated. 

This technique can equally be applied to a digital microphone. A microphone 
is simply a device that measures the movement of a diaphragm to produce an 
10 output. In principle there is no reason why this measurement problem cannot 
be resolved using this laser speckle technique, to produce a digital 
microphone. The key problem associated with the microphone is that 
movement of the diaphragm results in a motion normal to the surface, 
whereas this technique resolves motion along axes in the plane of the surface. 

15 Careful arrangement of the laser source and sensor can translate the normal 
motion of the surface into one that may be measured by our technique. 
Figure 4 illustrates one such physical arrangement By angling the detector, 
speckle movement due to the diaphragm can be amplified to an arbitrary 
(user selectable) degree. The greater the movement amplification however, 

20 the less the incident light that falls on the detector, thus a balance must be 
reached. 

Advantages of a digital microphone are numerous, and a direct conversion at 
the diaphragm itself provides the optimum results (no intermediate 
processing). This technique also allows the conversion to take place at a 
25 selected area on the diaphragm. This can be selected to minimise the 

distortion that normally occurs at the edges of the diaphragm. 



• * • • • • 
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CLAIMS 

1. A device for determining movement of a surface relative to a detector, 
the detector comprising a source of radiation directed at the surface and a 
plurality of radiation sensors arranged to detect an intensity pattern due to 

5 interference in the radiation reflected back from the surface, the device also 
comprising means for repeatedly or continuously monitoring the outputs 
from the sensors, and comparison means for calculating the interstitial spatial 
and temporal intensity gradients between adjacent sensors and using said 
gradients to yield a result indicative of the movement of the surface relative 

10 to the detector. 

2. A device according to Claim 1, where the device has radiation sensors 
and/or wherein the device monitors the outputs from the sensors 
continuously or for many repeats thereby enabling spatial and/or temporal 
over-sampling, respectively. 

15 3. A device according to Claim 1 or 2, wherein the radiation is coherent 

radiation. 

4. A device according to Claim 3, wherein the radiation source is a laser. 

5. A device according to Claim 1, 2, 3 or 4 comprising a two-dimensional 
array of the radiation sensors. 

20 6. A device according to Claim 5 wherein the array comprises two 
intersecting lines of sensors extending substantially perpendicularly to each 
other. 

7. A device according to Claim 6 wherein the array comprises at least 
two sensors in each orthogonal direction. 

25 8. A device according to Claim 7, wherein the array comprises eight 
sensors in each orthogonal direction. 
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9. A device according to any of Claims 5 to 8, comprising means for 
calculating for each adjacent pair of sensors in the array and for each 
successive pair of samples the gradient of the interstitial point in space and 
time according to the respective formulae: 

5 ((P-Q) + (S-R))/2....I 

((P-S) + (Q-R))/2....H 

wherein P and Q are the intensities measured by the adjacent sensors, and S 
and R ar the intensities measured by the same sensors in the temporally next 
sample, means for multiplying together the two gradients, and means 
10 employing the formula: 

IflxII) /I (I) 2 

for calculating displacement from one sample to the next. 

10. A device according to any of Claims 5 to 8, comprising means for 
calculating the displacement from one sample to the next by employing the 

15 formula: 

^[SJGNfSGiJxTGA/lABSfSGi) 
i=l i=l 

Where SG and TG are respectively the spatial and temporal gradients 
20 between adjacent pairs of sensors. 

11. A device according to any of Claims 5 to 8 comprising means for 
calculating the displacement from one sample to the next by employing the 
forumula: 

71-1 

25 l[SIGN(SG:)xSIGN(TG:)]f(n-l) 
i=l 
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12 A pointing device for a computer, comprising a device according to 
any preceding C laim and a body having an aperture or window therein 
movable across a surface and means for mounting within the body in fixed 
relation to the aperture or window the radiation source and detector of said 
5 device, and interface means for transmitting to a computer signals 
representing the movements determined thereby. 

13. A pointing device for a computer, comprising a device according to 
any of Claims 1 to 11 and a body having a ball or other rolling member 
rollably mounted therein and means for mounting within the body in 

10 substantially fixed relation to the surface of the ball the radiation source and 
detector of said device, and interface means for transmitting to a computer 
signals representing the movements determined thereby. 

14. A device for determining movement of a surface, substantially as 
described herein with reference to, or as shown in, the drawings. 

15 15. A pointing device for a computer, substantially as described with 
reference to, or as shown in, Figures 1 to 7 of the drawings. 

16. A method of detennining movement of a surface relative to a 
radiation detector, comprising directing radiation at the surface and 
detecting by the radiation detector an intensity pattern due to interference in 
20 the radiation reflected from the surface, the detector comprising a plurality 
of radiation sensors, repeatedly or continuously monitoring the outputs from 
the sensors, and calculating the interstitial spatial and temporal intensity 
gradients between adjacent sensors and using said gradients to yield a result 
indicative of the movement of the surface relative to the detector. 

25 17. A method according to Claim 16, wherein the radiation is coherent 
radiation. 

18. A method according to Claim 16 or 17, wherein the radiation is 
electromagnetic radiation and is preferably infra red or visible light 
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19. A method according to Claim 16, 17 or 18 comprising using a two- 
dimensional array of sensors to detect the intensity pattern. 

20. A method according to Claim 19, wherein the array comprises two 
intersecting lines of sensors extending substantially perpendicularly to each 
other. 

21. A method according to Claim 20, wherein the array comprises at least 
two sensors in each orthogonal direction. 

22. A method according to Claim 21, wherein the array comprises eight 
sensors in each orthogonal direction. 

23. A method according to any of Claims 20 to 22, comprising calculating 
for each adjacent pair of sensors in the array and for each successive pair of 
samples the gradient of the interstitial point in space and time according to 
the respective formulae: 

((P-Q) + (S-R))/2....I 

((P-S) + (Q.R))/2....H 

wherein P and Q are the intensities measured by the adjacent sensors, and S 
and R are the intensities measured by the same sensors in the next sample, 
multiplying together the two gradients, and calculating displacement from 
one sample to the next from the formula: 

2(IxE)/2(I 2 ) 

24. A method according to any of Claims 20 to 22 comprising calculating 
the displacement from one sample to the next by employing the formula: 

/i-l n-l 

ZlSIGNQGJxTGA/IABSfSGi) 
i=l z=l 
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25. A method according to any of Claims 20 to 22 comprising calculating 
the displacement from one sample to the next by employing the formula: 

n-1 

2\$IGN(SGj)xSIGN(TGj)]/(n-l) 

26. A method of determining the movement of a surface, substantially as 
described with reference to the drawings. 

27. A digital microphone device comprising a device according to any 
preceding apparatus Claim and a diaphragm responsive to sound waves 
wherein the radiation impinges on the surface of the diaphragm in order that 
motion normal to the diaphragm can be detected by measuring the 
displacement of the speckle pattern. 
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